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The system of ultracold atoms with hyperfine spin F = 3/2 might be unstable against the for- 
mation of quintet pairs if the interaction is attractive in the quintet channel. We have investigated 
the behavior of correlation functions in a model including only s-wave interactions at quarter filling 
by large-scale density matrix renormalization group simulations. The correlations of quintet pairs 
remain short-ranged even for strong attractive interaction in the paramagnetic ground state. They 
become, however, quasi-long-ranged when the system is partially polarized, in a broad range around 
two thirds of saturation. We also discuss possible experimental realizations and detection of quintet 
pairing in the system of ultracold atoms. 

PACS numbers: 71.30.+h, 71.10.Fd 



Recently ultracold atomic and molecular systems have 
been in the focus of theoretical and experimental studies 
not only in atomic and molecular physics but also in con- 
densed matter physics This is due to the fact that 
these systems provide controllable simulators of compli- 
cated condensed matter systems. It is expected that they 
will provide answers for a series of long-standing ques- 
tions related to topics like Mott transition, BEC to BCS 
crossover, non- Fermi liquid behavior of high- T c supercon- 
ductors, or anomalous quantum Hall effect. Moreover, 
atomic systems with hyperfine spin degrees of freedom 
higher than 1/2 can show completely new behavior for 
both bosonic and fcrmionic systems. For repulsive inter- 
action various Mott insulating phases, (chiral) spin liquid 
states, resonating plaquette order, spin-quadrupole and 
even higher multipole order Q can occur in two- or three- 
dimensional systems, while in one dimension a general- 
ized Peierls-like distortion can characterize the ground 
state with oscillating bond-order parameter For at- 
tractive interactions bound trionic and quartet states 
have been predicted for one- and three-dimensional sys- 
tems as well 0]. 

In addition to the usual singlet BCS pairs, nonsinglet 
pairs can also occur in principle if the appropriate com- 
ponent of the interaction is attractive. Due to symmetry 
reasons, spin-triplet pairs of spin- 1/2 electrons can exist 
only in p-wave - or more generally in odd-^-wave - su- 
perconductors, while s-wave pairs of higher spin fermions 
can also be in a nonsinglet spin state, e.g., F = 3/2 
fermions may form spin-2 (quintet) pairs. These states 
are of particular interest for their exotic properties espe- 
cially in magnetic field [5] . 

For a long time magnetic ordering and superconduc- 
tivity were thought to be incompatible. In fact homoge- 
neous ferromagnetic order does not allow a homogeneous 



superconducting order of singlet Cooper pairs. Coexis- 
tence is possible for p-wave triplet pairs Q or in inhomo- 
geneous singlet superconductivity with finite momentum 
of the pairs, i.e., in the Fulde-Ferrell-Larkin-Ovchinnikov 
(FFLO) phase Q. 

In this Letter, we study the possible formation of lo- 
cal quintet pairs and their stability in a one-dimensional 
chain of fermionic atoms with hyperfine spin F = 3/2, 
when the interaction is attractive in the quintet channel. 
We consider a quarter-filled system, namely, the number 
of particles is equal to the number of sites. We show 
that although correlation functions of quintet pairs de- 
cay exponentially in the paramagnetic ground state, the 
quintet pairs can be stabilized by a strong enough ex- 
ternal magnetic field due to population imbalance of the 
particles with different spin components. The correlation 
of quintet pairs shows algebraic decay and quintet pair- 
ing becomes the dominant instability in the system. This 
can occur in a wide range of the magnetic field. The main 
advantage of the presented model is that it contains only 
s-wave interaction and the emergence of quintet pairing 
does not require p-wave Feschbach resonance, thus ex- 
perimental realization of non-singlet pairs becomes much 
easier. 

The scattering processes between the scattering parti- 
cles with hyperfine spin F can be classified into indepen- 
dent spin channels characterized by the total spin (S) 
of the two scattered atoms: V — YjS=o9sPs> where 
Ps projects onto the total spin S subspace and gs is 
the coupling constant in the corresponding channel. The 
gs is related to the as s-wave scattering length in the 
total spin S scattering channel as gs — A ^ h v as with 
v atomic mass. The projectors are expressed via the 
pairing operators as P s = £„ M P% m ,i P s m ,i wh[ ^ are 
defined through the Clebsch-Gordan coefficients |9| and 
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the c a i spin-a fermion creation operator as Pg m i = 

Yl a ,0 (|) %'i a >0\S,m) c a ,i c p,i> where m is the z compo- 
nent of the total spin of the two scattering particles. 
Starting from a fermionic spin-3/2 Hubbard-like model 
with on-site interaction, the only contributing terms are 
antisymmetric under the exchange of the spin of the two 
colliding atoms, therefore, only the 5 = and S = 2 
terms may appear. Thus the Hamiltonian of the system 
reads as 

n = - t T,( c U c ^+i+ H - c -)+9^+92P2, (1) 

where t measures the overlap between neighboring sites. 
For attractive couplings (go < 0,g 2 < 0) the above 
Hamiltonian suggests that singlet and quintet pairs are 
competing. The region with repulsive interaction in the 
singlet channel (go > 0) turned out to be more relevant 
for quintet pairing. We will therefore consider the case 
go > 0, <?2 < 0, where quintet pairing competes with den- 
sity waves, as seen if the Hamiltonian ([1]) is rewritten in 

terms of the density, m = Y, a n a^ = ^2a c a,i c a,^ and 
the P 2 quintet projector as 

n = -* E ( c L c cm+i + H - c ) + ^ 5>? + ( 2 ) 

with couplings U — 2go, V — gi ~ go- 

First we have studied the stability of quintet pairs in 
the simplest way, i.e., within a self-consistent mean-field 
approximation. Due to the competing terms in Hamil- 
tonian Q we supposed site-centered quintet pairs and 
atomic density wave characterized by the pairing or- 
der parameters (P] m j) (m = —2,..., 2) and (n,-), re- 
spectively. Since the atoms have four different inter- 
nal states in spin-3/2 systems, it is natural to assume 
a maximum four-fold periodicity at quarter filling. Ac- 
cordingly we considered a 4-sublattice ansatz to solve the 
self-consistent mean-field equations and to determine the 
mean-field phase diagram. Two different stable phases 
are found in the quadrant go > 0, g2 < separated 
by a line lying around gi = — 1 (in units of the hop- 
ping parameter t) . For weak attractive quintet couplings 
(— f < g 2 < 0) the system is in the Mott phase: (m) = 2 
on odd sites and (nj) = on even sites, or vice versa. For 
stronger attractive quintet couplings the atomic density 
oscillates in the same way as in the other phase, however, 
in addition to that the quintet pairing order parameter 
(P 20 i ) becomes finite, i.e., local quintet pairs with m = 
are formed on every other site. 

This mean-field phase diagram turns out to be incor- 
rect for one-dimensional systems. Analytic calculation 
in the weak-coupling limit [10( shows that the leading in- 
stability for go > 0, 32 < is the formation of site- or 
bond-centered quartets. In order to search for possible 
conditions that might stabilize the quintet Cooper-pairs 
in one dimension we have studied numerically the phase 



diagram of model Q]) for gi < at quarter filling us- 
ing the density matrix renormalization group (DMRG) 
method ||. The simulations have been performed with 
open boundary condition up to L = 64 sites, keeping 
500 — 1000 block states and using up to 8 sweeps. Prop- 
erties of the various phases have been determined by an- 
alyzing the decay of several correlation functions, like 
different pairings, quarteting, density and spin correla- 
tion functions, respectively: XSm(i) = ( p Sm,i P Sm,i+i) > 
with to = 0, ±1, ±2, xqOO = (QiQi+i), Xn(i) = 
(nxni+i) - (m){ni +i ), Xm(i) = (mirai+i) - (mi)(mi+,), 
where rhi — ^ a an a ,i and the operator to study quar- 
teting is Q\ = cl /2 i c\ /2 J_ 1/2 J_ 3/2 i . The analysis of 
the above defined correlation functions confirmed the ab- 
sence of quintet Cooper pairs in ID system in the absence 
of magnetic field, since the quintet pairing correlations 
(X2m) decay exponentially for all to in the whole quad- 
rant on > 0, gi < 0. We have found, in agreement with 
Ref. [lfj, that \Q an d Xn show algebraic decay in the 
regime where site-centered quartet phase was predicted 
by weak coupling analysis. 

The spin singlet quartets which are formed from an 
equal number of atoms with spin components: a — 
3/2,1/2,-1/2 and —3/2 could be broken and quintet 
pairs could be stabilized, if a population imbalance oc- 
curs in the number of fermions with different spin com- 
ponents. This can be achieved, for example, by switch- 
ing on a magnetic field (B) which couples linearly to the 
magnetization to = 4 Si^i) measured in units of Bohr 
magneton. Therefore, we have calculated the correlation 
functions for increasing magnetization from rh — up to 
the maximum value to = 3/2. 

Before presenting the results, it is interesting to see 
how the number of atoms with spin components a = 
—3/2,-1/2, and 1/2 decreases in increasing field while 
more and more atoms have a = 3/2. This depends on 
the interaction between the particles. Performing calcu- 
lations at several points in the (go > 0,32 < 0) quadrant 
we have found two types of dependence of (n a ,i) on to as 
displayed in Fig. [T] The regions, where one or the other 
behavior is realized, correspond roughly to the regions, 
where the site-centered or the bond-centered phase is the 
to = ground state [Io| . The pictograms at to = in 
Fig. Q] indicate these states. The transition between the 
two types of behaviors occurs roughly around go = — 3^2 • 

For to > 1 the model becomes independent of go due to 
the absence of fermions with a = —3/2 and —1/2 in both 
regions. The quintet correlation function X22 shows an 
algebraic decay as shown in Fig. [21 while all other X2m are 
zero. The Fourier spectrum of X22 has a peak at tt, which 
indicates two-site periodicity of the quintet correlations, 
although, the particle density remains homogeneous in 
agreement with the expectations in one dimension. This 
spatial correlation is illustrated by the pictograms in 
Fig. U local quintet pairs of atoms with a = 3/2 and 1/2 
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FIG. 1. (Color online) Density of the fermions with different 
spin component vs. magnetization rh for a chain with L — 64 
sites (a) at go = 2, g-z = —4, and (b) at go = 20, 32 = 
—4. The pictograms illustrate the spatial structure of the 
quarteting, pairing quintet and ferromagnetic phases (see the 
text for the details). Shading of the circles corresponds to 
the different a hyperfine spin components of the atoms, and 
the lines connecting the atoms indicate that the atoms form 
pairs and quartets with finite anomalous expectation values: 
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FIG. 2. (Color online) Decay of the quintet correlation func- 
tions X2m for rh — 0, rh = 13/16, rh — 1 and rh = 5/4, 
calculated for go = 2, 172 = —4. For the length of the chain 
L = 64. 



can be formed at quarter filling only on every other site. 
In addition, \n and Xm decay algebraically with the same 
periodicity as X22, but Xn(i) = Xm{i) = (-l) i X22(«)- As 
the imbalance of the two remaining spin components is 
increased, and the weight of the a — 1/2 spin component 
decreases, the m = 2 quintet pairs start to dissolve and 
a ferromagnetic background appears. Nevertheless, the 
quintet pairing (X22) is the most slowly decaying correla- 
tion function for a broad region of rh (see Fig[5|) , although 
its periodicity becomes incommensurate with the lattice, 



and the leading Fourier component of X22 shifts from tt 
towards 0. The system becomes ferromagnetically or- 
dered at rh — 3/2, and the Fourier spectrum has a single 
peak at q = 0. This behavior is inj3omplete agreement 
with the results of Batrouni et al. 
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since our model 
can be mapped exactly to their model when m > 1 . This 
FFLO phase has also been studied in two component, 
spin polarized systems both theoretically (l2j and exper- 
imentally 13 1 . 

In contrast to this, the population imbalance of 
fermions with different spin components shows markedly 
different character in the two regions for m < 1. For- 
go < — 3(?2 (Fig- Hk) all spin components start to gain 
finite weight for rh < 1. As a consequence, the density of 
the spin quintet pairs starts to decrease, but X22 remains 
the slowest decaying correlation function in the system 
at least when rh > 3/4. Although, it is difficult to distin- 
guish between an exponential or algebraic decay of the 
correlation functions below rh « 3/4, the quintet pair- 
ing is still the dominant instability even slightly below 
rh = 3/4. Due to the emergence of the paramagneti- 
cally favoured spin-singlet quartets, the leading Fourier 
component of X22 shifts towards 7r/2. Even though all 
spin components have finite weight, the other correlation 
functions Xim with m = 0, ±1, and —2 decays exponen- 
tially (Fig. H]) for rh < 1. 

A different behavior is found for g > — 3^2 (Fig- [lb)- 
As the polarization decreases from rh = 1 to 3/4, the den- 
sity of atoms with —3/2 spin component remains zero, 
half of the atoms have a = 3/2, while the density of 
atoms with a = ±1/2 varies linearly with rh becoming 
equal at rh — 3/4. In the whole range X2,-2 and X2,-i 
are equal to zero due to the missing a — —3/2 spin com- 
ponent and X20 decays exponentially. On the other hand, 
the slowest decaying correlation functions, X21 and X22 
show algebraic decay with identical exponent as shown 
in Fig. [3] As (n_ 1 / 2 ) is increasing, the density of the 
rn = 1 pairs also increases and the number of the m = 2 
pairs decreases. The amplitude of X21 increases accord- 
ingly and the leading Fourier-component of the X22 and 
X21 correlation functions shifts from 7T toward 7t/2. This 
spatial correlation can be illustrated as if quintet pairs of 
a = 3/2 and a = 1/2 atoms were alternating with quintet 
pairs of a = 3/2 and a = —1/2 atoms as shown in Fig.[T|3. 
Therefore, the one-component quintet pairing found for 
rn > 1 is replaced by a two-component quintet pairing for 
rh < 1 . We have found that the m — 1 and m = 2 quintet 
pairing remain the dominant instability also for rh < 3/4 
at least for strong enough imbalance. For smaller val- 
ues of rh all X2m decay exponentially (Fig. [2]) due to the 
emergence of the paramagnetically favoured spin-singlet 
quartets and the leading Fourier component of X2m re- 
mains at tt/2. 

Spin-3/2 fermionic condensation could be realized ex- 
perimentally not only in 3D but in ID, too, using 132 Cs, 
9 Be, 135 Ba, 137 Ba |l|. Since according to the results 
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FIG. 3. (Color online) Decay of the quintet correlation func- 
tion X2m for in = 0, 3/4 and 1 calculated at go — 20, g-2 = —4. 



presented above quintet pairs exists in a wide range of 
magnetization for attractive quintet interaction, the ex- 
perimental realization of the quintet superfluid does not 
require fine tuning in the (go, 92,1^) parameter space. 
In addition, the presented quintet pairing phases can be 
stabilized via s-wave Feschbach resonance avoiding the 
difficulties with inelastic loss of p-wave scatterings. To 
detect the m = 1 and m = 2 quintet pairs, it is cru- 
cial to probe the pairing and to measure the underlying 
magnetic order. There are several possibilities to probe 
these many-body correlation effects, for instance, pair- 
ing can be probed by time-of-fiight absorption image [H| 
or the pa ir g ap can be studied by radio-frequency spec- 
troscopy [16| or momentum-resolved Bragg-spectroscopy 
17]. In addition, magnetic excitations can also be 
observed by quantum- noise spectroscopy (l8| . Elastic 
Bragg-spectroscopy [19j can also be applied to detect the 
variation of the periodicity of the quintet pairs. 

In this work, we have investigated the competition be- 
tween density wave and pair formation in the system of 
F = 3/2 cold atoms in one-dimensional optical traps 
at quarter filling. The behavior of various correlation 
functions has been studied via large-scale, high precision 
DMRG simulations. We have found that external mag- 
netic field can stabilize different quintet pair states when 
the spin-population imbalance of fermions breaks up the 
singlet quartets. While we have found an FFLO-like state 
of to = 2 quintet pairs for large population imbalance, 
two-component superfluidity with both m = 2 and 777 = 1 
pairs characterizes the system for intermediate values of 
the magnetization. Since our model contains only s-wave 
interaction, this result opens a new possibility for the ex- 
perimental realization and detection of nonsinglet pairing 
with ultracold atomic systems. We also suggest that in 
higher dimensional systems, where a mean-field solution 
might be more reliable, and quintet pairs may exist even 
in the paramagnetic case, external field can further sta- 
bilize them. 
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